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SIMULTANEOUS  TESTS  FOR  TREND  AND  SERIAL  CORRELATIONS 
FOR  GAUSSIAN  MARKOV  RESIDUALS 

By  P.  R.  Krishnaiaii  and  V.  K.  Murthy1 

In  thia  par  -  exact  tests  arc  proposed  for  testing  the  trend  in  the  presence  of  auto¬ 
correlation  a.  .Iso  for  testing  the  trend  and  autocorrelation  simultaneous!;,  in  a  first 
order  Markov  process.  Also,  the  simultaneous  confidence  intervals  associated  with 
these  tests  are  derived.  These  results  are  extended  to  a  higher  order  Markov  process. 


SUMMARY 

By  extending  a  result  of  Ogawara  [9],  the  problem  of  estimating  the  trend 
parameters  when  the  residuals  are  serially  correlated  according  to  an  /ith  order 
stationary  Gaussian  Markov  process  is  reduced  to  the  classical  ease  where  the 
residuals  are  uncorrciatcd  and  hence  independent  in  view  of  normality.  In  this 
paper  the  problems  of  testing  for  the  trend  and  other  simultaneous  hypotheses  on 
the  parameters  are  considered  when  the  residuals  are  respectively  a  first  and  a 
general  /ith  order  Markov  process  of  normal  variates.  Exact  tests  are  obtained  for 
testing  the  trend  in  the  presence  of  autocorrelation  and  also  for  testing  the  trend 
and  autocorrelation  simultaneously  in  a  first  order  Markov  process.  The  simulta¬ 
neous  confidence  bounds  associated  with  these  tests  are  also  derived.  These  results 
are  extended  to  Ath  order  Markov  process.  For  a  general  stationary  Markov- 
process,  exact  tests  are  proposed  for  testing  the  hypotheses  of  (i)  no  trend  in  the 
presence  of  serial  correlations,  (ii)  independence  among  errors,  and  (iii)  independ¬ 
ence  and  no  trend  among  errors.  The  critical  values  associated  with  these  tests  can 
be  obtained  by  using  the  tables  of  the  multivariate  F  distribution. 

I.  INTRODUCTION  AND  PRELIMINARY  LEMMAS 

Let  n  be  a  discrete  time  parameter.  Let  {T„}  be  a  discrete  stochastic  process  of 
normal  variates  and  suppose 

(11)  XH  =  ftn+e„, 

where  n„  is  a  non-random  function  of  the  parameter  n  and  {rfl}  is  a  Gaussian 
stationary  Markov  process  of  order  A  with  zero  mean  value.  Equation  (1.1)  is 
called  a  model  for  fitting  trend  if  (t,  is  a  function  of  the  discrete  time  parameter  n 
only.  On  the  other  hand  (1.1)  is  called  a  multiple  regression  model  if 

(1-2)  P(,=aa  +  ^l'J|),  +  ^2^2),+  •••  +PP£,m> 

where  the  t’s  arc  fixed  variables,  generally  referred  to  as  independent  variables.  The 
following  two  lemmas  which  we  need  in  our  further  work  arc  direct  extensions  to 

1  The  authors -ire  grateful  to  the  referee  and  Professor  M.  M.  Rao  for  their  valuable  suggestions. 

.472 


MARKOV  RliSIOUAI  S 


473 


the  ease  of  a  general  ;i„  of  the  corresponding  lemmas  gi'en  by  Ogawara  [9).  The 
proofs  arc  omitted  as  they  arc  essentially  contained  itt  reference  [9]. 

LtiMMA  I :  For  {A'„}  given  by  (1.1),  let 

(1-3)  Var(eB)  =  <r2 , 

Cov(<;n,  .  pel. 

The  stationary,  Gaussian,  and  satisfying  (1 .3),  arc  called  a  Gaussian  stationary 
Markov  process  of  order  one.  Then  the  conditional  random  variables  {A\K/X2K_,. 

A'2A  , ,  K-  I.  2 . m  are  independently  normally  distributed  random  variables 

with  conditional  expectation  atul  variance  given  by 

/t  a\  v  (V  \  _  ..  |_/<2K  -1  +/I2K  +  1  ,  L  1  +  &IK  *  t 

(1.4)  bt(XiK)  =  n2ti-b - 2 - +b - ^ - • 

and 

(1.5)  Varc.(X2K)  =  <To  , 
where 

(1.6)  b  = 

1 +/»* 

(1.7)  ol  =  0,2(1  ~?2)  ■ 

1  +p 2 


Lp.mma  2:  For  {T„}  given  by  (1.1),  let  {eB}  be  a  stationary  Gaussian  Markov 
process  of  order  h,  i.c.,  the  autocorrelation  function  pK  satisfies  the  finite  ditference 
equation 

(1-8)  Pk+QiPk-i  +  •••  +<**/**;-* ^ 0,  Af=I,2, atjt0 

and  the  «'s  arc  such  that  the  roots  of  the  equation 
(1.9)  ...  +<i^-lz+a*  =  0 

all  lie  within  the  unit  circle.  Then  the  conditional  random  variables  {A\()1 , , ,/ 
Xmh*  1  )-r  X*o,+  D+p-  P  =  1*  2, . . .,  A},  K  =  1,  2, . ...  m,  arc  independently  normal¬ 
ly  distributed  with  conditional  expectation  and  variance  given  by 
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and 

<1.10  Vart. ( A\(),  i  i  —  t>o  . 


where 

}.  P  =  1 

2. 

..  A,  are  given  by 

[K 

1  •  •  •  Ph-  t  Ph*  l  •  •  ■  Plh 

-t 

Ph 

V, 

Ph- 1 

(1.12) 

ft. 

~  2 

Ph- 1  ...  I  Pi  •  ■  ■  Ph*  i 

Pi 

ft. 

Ph* 1  •  •  •  Pi  1  ■  •  •  Ph- 1 

Pi 

Jk 

_Plh  ■  ■  Ph~  t  •  >  •  1 

_ph 

and 


(1.13)  =  i+aiPi  +  -  +a«/k  a  . 

!+(>?+  -  +  «» 

2,  EXACT  TESTS  FOR  LINEAR  TREND  AND  SERIAL  CORRELATION  IN  FIRST  ORDER 

MARKOV  PROCESS 

Consider 

(2.1)  XK  =  p„-¥eH, 

where 

(2.2)  /<,  =  «•!/>« , 

and  the  stationary  process  { cm }  of  normal  variates  satisfies  (1.3).  (2.1)  and  (2.2) 
constitute  the  model  for  linear  trend  when  the  residuals  {«„}  are  no  longer  independ* 
ent  but  form  a  stationary  Gaussian  Markov  process  of  order  one.  Substituting 

(2.2)  in  (1.4)  we  obtain  for  the  conditional  expectation  and  variance  of  XiK  given 
X,  K  _ ,  and  A'2K , ,  the  following: 

(2.3)  Ec {X1K)  -  Pt  +Pj  K  +/),,  X'K  ,  K  =  1.  2 . m  ; 

Pi  =  «(l  -b)  , 

Pi  ~  2/7(1  -b) , 

Pi  =  b  =  .  2'y_  , 

i  tV 

V'  _  ^  2K-  1  +  Af2K  f  , 

A  K - - 2 - ’ 


where 

(2.4) 
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and 

(2.5)  Vai,.(A',k.)  -  SJIZOI, 

l+P* 

liquations  (2.3)  (2.5)  constitute  the  usual  regression  model  for  independent 
residuals  with  ft,  and  /I.  corresponding  to  lilting  a  linear  trend  and  fiy  which 
vanishes  if  and  only  if  p  -----  0,  corresponding  to  fitting  (lie  fixed  variate  X‘K. 

Let  us  now  consider  the  problem  of  testing  for  trend  in  the  original  model  given 
by  (2.1)  and  (2.2).  Let  //,,  denote  tiie  hypothesis  that  there  is  no  linear  trend  in  the 
model  (2.1),  i.c., 


Let 

//0!:  a  =  0 
and 

ft  —  0 . 

Then  H0  -  //01  r\  //0! .  Let  //0J  denote  the  hypothesis  that  the  stationary  Gaussian 
process  {£„}  is  a  process  of  independent  variates.  In  other  words  Hoi:  p-0. 
Using  the  symbol  o  to  denote  “implies  and  is  implied  by”  it  is  clear  from  (2.4)  that 

Of  s=  o  <■>  // !  =0, 

(2.6)  /!»  Oo/Jj-O, 

p  .=  0  o  IS  ,  =  0 , 

since  l>4\.  So,  the  hypothesis  //0  of  “no  linear  trend”  in  the  given  model  (2.1)  is 
equivalent  to  the  hypothesis  that  /I,  ^=0  and  ftz  =  0  in  the  conditional  model  (2.3) 
which  is  a  classical  regression  model  with  independent  residuals.  Now,  let  ft,  be  the 
least  squares  estimate  of  /I,  under  the  model  (2  3). 

It  is  known  from  normal  regression  theory  that  the  joint  distribution  of  ft,,  ftz, 
and  /)3  is  trivariate  normal  with  means  /!,.  // > ,  and  //.,  and  the  covariance  matrix 
I  —  of,  (c,j)  where  <r„  is  given  in  (1.7)  and  (c,y)  denoies  the  inverse  of  the  matrix  of 
the  coefficients  of  normal  equations  used  in  estimating  ft,,  flz,  and  /(,.  Now.  let 
H0, :  ft,  =  0  for  i  =  1 .  2.  3  and  let  S;  be  the  sum  of  squares  due  to  deviations  from 
regression  (2.6).  In  addition,  let 

F,  =  (W-3)A~  ,  i  =  L  2,  3  . 

When  //„  is  true,  ft,/e„ol  and  ftll<'z>cl  are  join  ly  distributed  as  a  bivariate  chi- 
square  distribution  witli  I  degree  of  freedom.  Also.  Syjaf,  is  another  chi-square 
variate  with  (m-3)  degrees  of  freedom  distributed  independently  of  ft,  and  ft\. 
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When  H0  is  true,  we  know  from  [4,5]  that  the  joint  distribution  of  f,  and  Fl 
(.holding  A',,k_  ,  and  A'.,K  + ,  fixed)  is  given  by 


/,(/■«,  Fi) 


}/ffi(m-3)/ 2 


(2.7) 


V' 


(Or-)1' 


-3)(l  1\ +  F J  +21 


where  />,  >  r,  >/(<", .  Here  we  note  that  />u  de|K'iuls  upon  A’  and  the  fixed 
variates  A,.K_,  and  X2.Klt  only.  The  rule  for  the  testing  //0(.  /f0>.  and  //<> 
.simultaneously  is  described  below. 

Accept  or  reject  //0i  (/ »  1.  2)  according  as  Ft  <  l\  where  l\  is  chosen  such  that 
(2.8)  P[Ft^F,-  f«l,2|//0)*(l-«). 


The  total  hypothesis  //<,  is  accepted  if  and  only  if  //0,  and  //0J  are  accepted.  The 
critical  values  /•’„  can  be  obtained  by  using  the  tables  of  the  bivariate  F distribution 
with  (I,  n)  degrees  of  freedom.  The  simultaneous  confidence  intervals  associated 
with  the  above  test  are  given  by 

(2.9)  rM-fiA^F.CuSlKm-S) ;  /  ®  1,  2}  -  (1  -a) 

where  7a  is  given  by  (2.8).  The  above  simultaneous  confidence  intervals  based  upon 
the  distribution  of  (2.7)  arc  valid  since  our  test  procedure  is  associated  with  the 
conditional  model  (2.3).  They  can  be  derived  by  using  the  fact  that 


PIFt*  F„  i  *  t,  2|.4]  »  P\F,<  F.;  i  =  I.  21/U 


where 


F 


* 

i 


0i  ~  If, )z  (>»-}) 

c»S;. 


A,:  and  A  fi  -h  . 

i-i 


If  we  are  interested  in  testing  //„,,  IiQi,  and  //0j  simultaneously,  the  procedure  is 
to  accept  or  reject  //0)  (i  -  1, 2, 3)  according  as  F,  $  F,  where  Fa  is  chosen  such  that 

(2.10)  V [F, ^  i  =  1,  2,  3|  H  Wo, 3  »  d  -a)  ■ 

i 

» 

The  total  hypothesis  f|  //„„  that  is,  the  hypothesis  of  no  trend  and  no  serial 
j 

correlation,  is  accepted  if  and  only  if  the  individual  hypotheses  //0l,  //0>,  and  //„, 
arc  accepted.  The  joint  distribution  of  /’,.  F2.  and  when  f)//oj  *s  <ruc.  is  the 
trivariate  central  F distribution  with  (1,  m  —  3)  degrees  of  freedom,  for  a  detailed 
discussion  of  the  multivariate  /-  distribution,  the  reader  is  referred  to  [6,7].  Krish- 
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naiah  ami  Major  Armitintc  arc  constructing  tables  for  the  percentage  points  of  the 
multivariate  /■'  distribution  with  (1,/t)  degrees  of  freedom.  The  simultaneous 
confidence  bounds  tissoci;ited  with  this  test  are  given  by 

(2.11)  I’Ufi, -/!,)  <  )f<-usl  Fj(m  ~  3)  :  ( «  1.2,  3j  -  (I  -a) 
where  F,  is  chosen  satisfying  (2.10). 


3,  SIMULTANEOUS  lllSIS  IN  Vlll  OR  OIK  MARKOV  |‘K<K  IsSS 


Consider  the  model 


(3.1)  A,,  “  Fn  *1*  . 

where 

(3.2) 

und  the  stationary  process  {e„}  of  normnl  variates  satisfies  the  conditions  of 
Leinmn  2.  Now.  substituting  (3.2)  in  (1. 10).  we  obtain  the  following  expressions  for 
the  conditional  expectation  and  variance  of  A' *<*+,>  given  A'*,*, ,,  XKlh% 

{p  =  1.  2 . It), 

(3.3)  n)  ®* K  +  X  Pp  X't.K  * 

r- 

(3.4)  Var,.(  ATjfn  1 1>)  es  tfj  . 
where 


•f.« 


A ki»  i  1 1 — 1» "!■  A *.(*+  1 1 


1  F 


(3.5) 


/'.=«(!  -  I  y. 


r-  l 


ih  =  m-o>F\)  i  br) 

i***  i 

Px 


[  fih+i  "  hh , 

and  the  b' s  and  <7o  are  given  by  (1.12)  and  (1.13)  respectively. 
Now,  let 

//on  /#,-«.  i  =  1.2, ...,/» +  2  . 
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Also,  let 


F,  „ 

e„Si 


I  •»  I.  2,  .  . (A -I-  2) , 


where  /!,  is  (lie  leas?  square  estimate  of  />,  in  die  model  (3.3),  m  is  the  size  of  the 
sample.  St]  is  the  sum  of  squares  due  to  deviation  from  the  regression  (3,3),  and 
{c,t):(h  i-2)x(A  !•?.)  is  the  inverse  of  the  matrix  of  the  eoeilicients  of  normal 
equations  used  in  estimating  jl' s.  From  classical  regression  theory,  it  is  known  that 


<‘V  -  ( I  >v  rA 

\k*i  ~  —  / 

where  VK*  -•  (I,  K,  X'\tKl .  .  ..  XWj.k)  and  Yk  is  the  transpose  of  Y#  . 

We  shall  now  consider  the  problem  of  testing  //0,  and  //03  simultaneously. 

The  hypothesis  //oi  (/»  I.  2)  is  accepted  or  rejected  according  as  F,  §  1\  where 
l  t  is  chosen  such  thin 

i 

(3.6)  r  “  I.  2|  fl  "or.)  -  ft  -*#) . 

i- 1 


Here  wc  note  that  Ilol  and  Hoi  ure  respectively  equivalent  to  the  hypotheses  a  ■=■  0 
and  II  *»  0.  When  f ,  ll0l  is  true,  ,<r5  and  /fj/Cj  jOu  are  jointly  distributed  as 
n  bivariate  chi-square  distribution  with  1  degree  of  freedom.  Also.  Si  is  another 
chi-square  variate  with  {m-h~ 2)  degrees  uf  freedom  distributed  independently  of 
f!\  and  ll].  When  Hat  is  true,  wc  know  from  [4,5]  that  the  joint  distribution 
of  and  /‘i  (holding  .V*(fp , , , ,  p  and  XKiH , ,  fixed  for />  **  1,2 . A)  is  given  by 


fry  (»,-A-2)‘-fc-iWI( 

JeV  It  *  2/  *** - ■  —  -y+' 


(37) 


y 
<-0  ; 


| 'Or  I  ( m  -A  - 1  ):2 


m  ---  h 


i! f  ( / 1-  j ) IX f« -  A  - 2) (I  />;-> F ,  +  i  , J  — —  +  2/ 


where /»,j  ™  <•,,/(<•,  ,c,})5.  Here/',. .depends  upon  X  and  the  lixed  variates  .Vktfcl „ 

and  XKih,  />=  I,  2 . A.  The  simultaneous  confidence  intervals  associated 

with  the  above  test  are 


(3.8) 


/ 

’[i/v/f.i « y 


,<r0  Si 


(«»  —  A -2) 


/ 


1  ”j 


(I  -a) 


where  /'4  is  chosen  satisfying  (3.6). 

The  procedure  lot  testing  //0 , , ....  //„  *,  .  simultaneously  is  as  follows:  Accept 
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or  reject  I  “  I,  2. ....  /t  i  /!.  according  av  /  j  t\  where  /■',  is  chosen  such  di.it 


h .  > 


(3.9)  /«  1.2 . A  +  2|  n  »0, 


(1-er). 


<-t  J 

Wlienf*)  ;//y,  is  true,  the  joint  disti  ibution  of  /  j . /  j, ,  .  is  a  central  (7i  t-2)  variate 

/■’distribution  with  (I.  in—h  —  2)  degrees  of  freedom.  So.  the  critical  values  Ft  can 
be  obtained  from  (7).  The  simultaneous  confidence  intervals  associated  with  the 
above  test  me 


./ 

Ww-fiil  <  f'  -  h  -2);  /»  1.2 . h  t-  2]  *  (I  —a) 

where  i.i  is  chosen  satisfying  (3.9).  Here  we  note  that  the  hypothesis  /»,  =  ...  « 
f>„-Q  is  equivalent  to  the  hypothesis  flfjj  H0, . 

if  one  is  interested  in  testing  just  the  hypotheses,  //0i.  l(0i. ....  «0M : 
simultaneously,  the  critical  value  t\  should  be  chosen  such  that 


■  s+i 

F  l)<F,:  h  2|  0  II m 

.  i  ®  1 


~  (I  -a) . 


4.  OtiNtRAt.  RtiMARKS 


Under  model  (2.1).  one  rain  use  the  more  usual  /•’statistic  with  (2.  mi  — 3)  degrees 
of  freedom  to  test  //,,,  and  //,,.  (defined  in  Section  2)  simultaneously.  The  /•' 
statistic  in  this  ease  (using  the  notation  of  Section  2)  is 


A  l  /  C  1 

PlMr, 


r.  .\“ 1 


ii).\ 


Ihil  using  (lie  methods  in  |4,S|,  it  is  seen  that  the  Irugths  ot  the  confidence  intervals 
associated  with  the  simultaneous  test  procedure  proposed  in  Section  2  arc  shorter 
than  the  lengths  of  Ihe  corresponding  confidence  intervals  associated  with  the  over¬ 
all  /’test  procedure.  Similar  remarks  can  be  n  ude  for  testing  and  //„, 

simultaneously  under  the  model  (?.. ;  >  and  for  testing  various  hypotheses  simultane¬ 
ously  under  the  model  (3.1).  Hie  authors  are  not  aware  of  any  other  alternative  test 
procedures  for  testing  various  hypothe  cs  simultaneously  under  the  models  (2.1) 
and  (3.1).  The  optimum  properties  of  die  power  functions  of  the  simultaneous  test 
procedures  considered  in  this  paper  arc  under  investigation. 

Sometimes  the  experimenter  may  be  interested  in  testing  individual  hypotheses 
separately,  for  the  first  order  Markov  process,  the  test  procedure  in  this  case  is  to 
accept  or  reject  llt,  for  any  given  tj  according  as  /  j  $  F*  where  F,  and  H,  arc  defined 
in  Section  2  and  l  *  is  chosen  such  that 

PtFiO’JlWJ-ll--*). 


480 


P,  R.  KRISHNAIAH  AND  V.  K.  MURTHY 


The  associated  confidence  bound  is  given  by 

p  CIA  -  Pi\  <  irt  *u  Slum  -  3)]  =  (t  -  a) . 

Here  we  note  that  F*  is  the  upper  a  per  cent  value  of  the  central  /•'distribution  with 
(l,/n-3)  degrees  of  freedom.  Similar  test  procedures  can  be  proposed  for  the 
/tth  order  Markov  process. 

Aerospace  Research  Laboratories,  Wright- Patterson  AFB,  Ohio  and  the 
Douglas  Aircraft  Company,  California 
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